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Foreword 


The  stunning  changes  in  the  complexion  of  international  politics  that  began 
late  in  the  decade  of  the  1980s  and  continue  today  will  profoundly  affect  the 
American  military  establishment  as  a  whole,  and  the  US  Air  Force  in  particular. 
Decisions  about  the  future  course  of  the  military  will  be  made  in  the  early  part 
of  the  1990s  which  will  essentially  determine  the  course  of  the  US  Air  Force  well 
into  the  next  centuiy.  Decisions  of  such  importance  require  thoughtful  con¬ 
sideration  of  all  points  of  view. 

This  report  is  one  in  a  special  series  of  CADRE  Papers  which  address  many  of 
the  issues  that  decision  makers  must  consider  when  undertaking  such  momen¬ 
tous  decisions.  The  list  of  subjects  addressed  in  this  special  series  is  by  no  means 
exhaustive,  and  the  treatment  of  each  subject  is  certainly  not  definitive.  However, 
the  Papers  do  treat  topics  of  considerable  Importance  to  the  future  of  the  US  Air 
Force,  treat  them  with  care  and  originality,  and  provide  valuable  tnslghts. 


We  believe  this  special  series  of  CADRE  Papers  can  be  of  considerable  value  to 
policymakers  at  all  levels  as  they  plan  for  the  US  Air  Force  and  its  role  in  the 
so-called  postcontainment  environment. 


DENNIS  M.  DREW.  Col.  USAF 


Director 

Alrpower  Research  Institute 


V 


About  the 
Author 


Col  Raymond  E.  Franck,  Jr. 


Col  Raymond  E.  Franck.  Jr.,  is  permanent  professor  and  head.  Department  of 
Ek^onomics  and  Geography,  United  States  Air  Force  Academy  (USAF^^.  He  was 
bom  in  Sac  City.  Iowa,  28  August  1945.  He  graduated  from  Denison  Community 
High  School.  Denison.  Iowa,  in  1 963  and  entered  the  USAF A  that  year,  graduating 
in  1967.  The  recipient  of  a  National  Science  Fellowship,  he  then  entered  Harvard 
University  where  he  received  his  Master’s  and  Doctorate  in  Economics.  Colonel 
Franck  is  also  a  graduate  of  Squadron  Officer  School,  Air  Command  and  Staff 
College,  the  National  Security  Management  course,  and  Air  War  College. 

Colonel  Franck  entered  Undergraduate  Pilot  Training  at  Columbus  Air  Force 
Base  (AFB),  Mississippi,  in  1969  and  earned  his  pilot  wings  in  1970.  His  initial 
operational  experience  was  as  a  B-57  Canberra  pilot  and  mstructor  pilot.  He  was 
assigned  to  Holloman  AFB,  New  Mexico;  MacDill  AFB.  Florida;  Ubon  Royal  Thai 
AFB,  Thailand;  Kadena  Air  Base,  Japan;  and  Malmstrom  AFB.  Montana. 

In  1975,  Colonel  Franck  was  assigned  as  the  officer- in-charge  of  the  Air  Force 
Element,  Jomt  Operational  Control  Center.  Keflavik  Naval  Installation.  Iceland. 
In  1976,  he  joined  the  staff  at  USAFA  as  an  instructor  and  then  as  assistant 
professor  in  the  Department  of  Economics,  Geography  and  Management. 

Colonel  Franck  reported  to  the  Pentagon  as  staff  analyst  for  bomber  programs, 
the  Office  of  the  Assistant  Secretary  of  Defense  for  Program  Analysis  and 
Evaluation  in  1980.  Colonel  Franck  returned  to  flying  duties  after  his 
Washington,  D.C.  assignment  and  served  as  a  flight  commander  following  B-52 
checkout.  Later,  he  served  on  the  opieratlons  staff  of  the  2d  Bomb  Wing. 
Barksdale  AFB,  Louisiana. 

In  1985,  Colonel  Franck  was  assigned  to  Headquarters.  Strategic  Air  Com¬ 
mand,  Offutt  AFB,  Nebraska,  as  deputy  chief.  Program  Evaluation  Division,  and 
then  as  special  assistant  to  the  commander  in  chief.  Strategic  Air  Command, 
where  he  served  until  his  present  assignment  in  1989. 


iHi 


Executive  Summary 


This  paper  considers  the  question  of  cost  and  performance  In  major  weapon 
systems.  The  existing  state  of  technology  determines  what  is  possible  in  every 
new  design.  How  much  technology  to  incorporate  into  hardware  involves  choices 
between  performance  (better  quality)  and  lower  cost  (greater  numbere).  Current 
design  practices  place  a  decided  emphasis  on  performance. 

An  articulate  group  of  critics  with  a  large  following  charges  that  unchecked 
pursuit  of  technological  opportunities  precludes  intelligent  cost-performance 
choices.  Weapon  systems  feature  large  numbers  of  expensive  gadgets  that  add 
bttle  to  military  effectiveness  and  much  to  cost.  As  a  result,  we’re  buying  in 
numbers  too  small  to  be  really  effective.  ITiese  Issues  were  part  of  a  major  debate 
in  the  1970s  but  faded  somewhat  with  Increased  funding  during  the  1980s.  With 
the  drawdowns  and  reassessments  of  the  1990s,  the  question  of  numbers  versus 
performzmce  will  likely  return  to  prominence. 

Chapter  1  is  an  overview  of  past  experience  in  exploiting  technology  for  military 
purposes.  Traditionally,  the  slow  pace  of  innovation  and  institutional  conser¬ 
vatism  made  technology  a  minor  part  of  the  military  planning  problem.  However, 
modem  military  powers  specifically  plan  to  advance  military  technology  and 
exploit  that  progress  with  deployed  hardware.  The  most  radical  practitioner  of 
the  modem  approach  is  the  United  States,  which  regards  technical  superiority 
as  a  vital  national  interest. 

Chapter  2  is  a  summary  of  the  critics’  views.  Fundamentally,  they  assert  that 
the  acquisition  process  precludes  systematic,  rational  choices  between  cost  and 
performance.  New  weapons  reflect  the  pursuit  of  technical  opportunities  rather 
than  concern  for  militaiy  effectiveness.  Study  of  the  process  itself  underpins  the 
critics’  case.  Although  it  is  possible  to  find  fault  with  what  the  critics  say,  it  is 
difficult  to  defend  the  process  itself.  It  is  also  important  to  remember  that  the 
critics’  views  are  widely  shared  in  the  policy-making  community. 

Chapter  3  considers  the  empirical  record  and  concludes  that  system  designs 
show  evidence  of  a  consistent,  rational  pursuit  of  combat  effectiveness.  A  set  of 
66  Navy  and  Air  Force  tactical  aircraft  types  constitute  the  case  study.  The  data 
reveal  a  military  judgment  that  quality  is  more  important  than  quantity,  with  that 
assessment  consistently  reflected  in  actual  designs.  The  data  do  not  support  the 
critics’  belief  that  increments  in  performance  come  at  increasingly  higlier  cost . 

Chapter  4  looks  at  some  indicators  for  the  future.  First,  recent  studies  of  actual 
combat  results  suggest  that  quality  is  indeed  more  important  than  quantity. 
Second  is  the  effect  of  increased  uncertainty.  With  a  changing  threat  and 
planning  environment,  we  no  longer  have  a  predominant  scenario  such  as  Central 


ix 


Europe — therefore  we  have  more  uncertainty  in  our  plamiing  problem.  Insights 
from  the  theoiy  of  financial  portfolios  suggest  we  should  pay  extra  for  assets  that 
reduce  risk  in  force  performance.  Some  study  evidence  indicates  that  higher 
performance  forces  are  less  risky.  Hence,  there  is  reason  to  believe  that  continued 
emphasis  on  performance  is  appropriate  in  post-cold  war  system  designs. 
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Chapter  1 


Technology,  Cost,  and  Performance 
as  a  Military  Problem 


THE  purpose  of  this  paper  Is  to  explore 
the  Issue  of  cost  versus  performance  (or 
quality  versus  quantity)  In  major  weapon 
systems.  Every  weapon  design  evolves 
within  a  given  state  of  technology  that 
provides  a  menu  of  technical  options  and 
associated  costs.  How  much  available 
technology  to  Include  in  the  design  in¬ 
volves  choices  between  more  technology 
(higher  performance)  against  lower  cost 
(and  greater  numbers).' 


Historical  Record 

The  relationship  of  technology  to  the 
other  elements  of  the  art  of  war  and  the 
exploitation  of  technical  means  in 
hardware  design  is  not  a  new  issue.  The 
historical  record  indicates  that  tech¬ 
nological  Innovation  has  e-xerted  an  im¬ 
portant.  and  sometimes  dominant. 
Influence  on  military  operations.  How¬ 
ever.  history  demonstrates  that  more 
technology  does  not  always  equate  to 
greater  operational  effectiveness.  Ex¬ 
perience  also  shows  that  other  factors 
have  been  major,  sometimes  dominant, 
influences  as  well. 

Until  the  modem  era,  military  technol¬ 
ogy  progressed  slowly.  Before  the  twen¬ 
tieth  century  major  military  theorists 
could  take  technology  as  a  given 
phenomenon,  because  it  changed  little  in 
a  bfetlme.^  It  took  nearly  four  centuries 
to  fully  realize  the  potential  of  gunpowder 
in  terms  of  deployed  hardv/are.  doctrine, 
and  tactics.  Nearly  one  hundred  years 


after  demoiislration  ol  tecfmi(  al 
feasibility,  a  breech-lo;iding  infantiy  rille 
first  api>eared  as  standard  equipment.' 
l.intll  the  modern  era,  there  was  n<i 
defined  process  for  advancing  or  exploit  - 
Ing  tecluiology  for  military  purjioses.^  In¬ 
ventions  were  perfected,  deployed,  and 
then  forgotten.'^  Typically,  innovations  in 
hardware  resulted  from  the  efforts  of  in¬ 
dividual  Inventors  to  find  military  cus¬ 
tomers.®  In  short,  technical  iimovation 
was  not  the  provtnee  of  the  militaiy 
profession.  Commentators  from  Sun  T/u 
to  Clausewitz  and  Jonilnl  could  regard 
technology  as  essentially  fixed,  or  at  least 
as  a  matter  outside  tlielr  concern.  Even 
some  technically  oriented  tl'etrrlsts  of  the 
twentieth  ceniury  such  as  J.  F.  C.  Fuller 
and  B.  H.  Liddell  Hart  emphasized  the 
exploitation  of  particular  technologies 
rather  than  technical  progress  as  part  of 
military  planning. 

Traditionally,  military  institutions 
have  been  technically  conservative,  resis¬ 
tant  to  the  incorporation  of  new  tech¬ 
nologies  in  hardware,  and  reluctant  to 
reflect  new  technical  means  in  doctrine, 
tactics,  and  force  structure.®  Technology 
was  not  a  planning  variable  imUl  well 
after  the  Napoleonic  Wars.  'Prevor  N. 
Dupuy  credits  the  Prussian  general  staff 
of  the  nineteenth  century  as  being  tlie 
first  to  explicitly  plan  for  technical  in¬ 
novations.  Martin  L.  van  Creveld  em¬ 
phasizes  the  influence  of  twentieth 
century'  warfare  on  military  perceptions 
of  technology.® 
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Changes  .n  lullltary  (<■<  hnologv’  have 
always  exerted  a  peivasive  inlliiene<*  on 
the  conduct  ol  war.  Technologv-  defines 
what  Is  I'ossible  in  military  operations.'" 
Even  in  a/icient  t  nies.  teclmlcal  innova 
tions  or  even  a  relatively  small  technical 
edge  were  e.xtremely  important.  Ilie 
Romans'  incorporation  oi  bo.-  din>i  ramps 
on  galleys  ilid  much  to  wrest  comimind  ->1 
the  sea  Itoni  the  Carthaginians  in  the 
Piinic  Wars.  Similarly,  Ronum  use  ot 
shock  ami  lire  weapons  against  the 
simpler,  shock  tiriented  Hellenistic 
armies  was  a  key  ingredient  in  conquer¬ 
ing  the  eastern  Mediterranean.  "  Oc 
caslonally,  tJiere  has  been  a  decisive 
weapon  Ibr  which  the  enemy  had  no 
counter,  the  Byzantines'  Greek  tire- 
being  a  well-known  example,'^  One  can 
trace  historical  eras  in  military  art  and 
science  through  the  use  of  such 
dominant  weapons  as  the  longbow,  mus¬ 
ket,  a*id  quick-tiring  artillery.'^  In  1945 
Fuller  equated  vlctoiy  with  tlnding  the 
rigid  hardware,'"' 

Nonetheless,  technology  has  been  only 
one  of  many  factors  In  the  military 
balance.  Victory  has  always  involved 
matching  strengths  against  enemy  weak¬ 
nesses  and  masking  deficiencies;  more  a 
matter  of  defeating  an  opponent  ttian 
mastering  nature.  Many  military  revolu¬ 
tions  did  not  involve  tecturological  In¬ 
novation  per  se  but  rather  the 
imaginative  combination  of  existing 
means  of  war.  The  system  growing  out  of 
the  Frencii  Revolution  and  the  genius  of 
Napoleon  Is  one  example.  Tfie  German 
army’s  int  roduction  of  the  panzer  division 
is  another.'* 

Finally ,  exploiting  technology  is  poten¬ 
tially  dangerous.  Periods  of  technical  in¬ 
novation  have  sometimes  accompanied  a 
deterioration  In  other  rnilltaiy  arts;  a 
problem  dating  at  least  to  the  Hellenistic 
states  of  the  ancient  world."'  Of  even 
more  concern  is  the  tendency  of  factois 
other  tlian  military  effectiveness  to  In- 
flcence  hardware  design,  such  as  the 


puisuil  ol  lc(hnol<)t\\  loi  ii--,  own  s.ikr 
Martin  L.  van  Creveld  .s  asscssiin  nl  ol  tht* 
♦•ngincers  aiui  desigiwis  i>t  ihc  Ita'.i.m 
Renaissance  is  p.u  li-.  iilaiiv  iulei  eslinn: 
Tile-.’  apfilitsi  their  lnut),;mal  ion  s  to  tlx 
construction  ol  a  very  laigi-  numl^<“i  ol 
complii  altxl  machines,  the  teal  purpose 
ot  which  was  aiqiaienlly  not  so  mui  h  to 
do  uselul  work  a.-  to  e-.xploii-  wavs  in 
which  those  devices  couU’  be  com 
bineti 

Other  dangers  include  leihnical  in 
novations  nanowlv  locus«-d  on  es'ah 
lished  lines.  1'he  devices  intended  to  keep 
the  horse  cavaliy  a  viable  combat  arm 
alter  Work!  War  1  are  well  known  ex 
amples  of  divcaling  technology  (and  in 
vestment)  trom  the  direct  puisuit  ol 
military  effectiveness."'  Faking  estab¬ 
lished  lines  of  technology  to  e.xiremes  has 
resulted  In  warships  so  top-heavy  with 
new  devices  that  they  sank  on  their 
maiden  voyages  or  proved  otherwise 
operationally  ineffective.  File  extremely 
heacy  plate  of  armor  of  the  later  medieval 
period  is  another  exrtrnple.  Tltal  sor1  ol 
innovation  also  concentrated  fighting 
power  In  plallonns  so  few  and  so  prec  ious 
that  they  could  not  be  placed  in  harm  s 
way.  such  as  World  War  I  dreadnoughts. 
A  device  that  cannot  be  risked  has  only 
limited  cla  ms  to  being  a  weapon.'" 

Although  military  do  igns  have  always 
paid  a  premium  for  }>enormance.  it  is  not 
always  clear  how  much  is  too  much.^’ 
Airmen,  in  particular  have  disagreed. 
Fci  example,  Giullo  Douhet  advoc;ated 
;  the  battleplane"  (a  moderate  cost, 

!  moderate  performance  bomner),  a  view 
I  that  contrasts  wish  Air  Marshal  Hugti 
I  Trenchard's  emphasis  on  weapons  of 
1  first-rate  quality.^' 

The  Current  Situation 

In  contrast  to  tiie  military  proiesslon's 
traditionally  passive  attitude  towaid 
technology,  all  contemporar  r  great 
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powers  have  lai>Je  ajicl  expensive  niilltajy 
teehnleal  branches  cletikateci  (o  advanc¬ 
ing  the  state  ot  the  art  anil  exploitinjJ 
technical  possibilities  In  weapon 
(leslf^ns."'^  ■’.he  clearest  example  rl  leih- 
nlcal  emphasis  Is  ilie  contemporary 
United  States.  The  creation  aim  exploita 
tlon  of  technical  advantages  Is  an  Intejiral 
part  of  contemporary  national  security 
stratefiy.  and  technical  superiority  is 
regarded  as  a  major  national  intei  est  A 
notable  boily  of  opinion  and  research 
holds  tliat  contemporary  Western  prac 
tice  In  system  design  Is  tilted  almost  ex¬ 
clusively  toward  the  pursuit  of  tecluiology 
without  regard  to  cost.^'* 

It  Is  tempting  to  conclude  that  recent 
events  In  tlie  Gulf  war  settled  the  argu¬ 
ment  fn  favor  of  tfie  current  -  iiphasls  on 
performance  and  quality.  That  may  turn 
out  to  be  true.  The  current  generation  of 
hardware  has  worked  quite  well.^”  And. 
it  seems  natural  to  conclude  that  the 
services  have  made  good  choices  In 
■  lardware  design. 

To  regard  the  debate  on  cost  verses 
performance  as  permanently  closed  is 
more  likely  a  misinterpretation  of  the  les¬ 
sons  of  Operation  Deseii  Storm,  future 
directions  in  military  technology,  the  per¬ 
sistence  of  the  critics,  and  the  fiscal  fu¬ 
ture.  First,  the  stars  of  the  Gidf 
operations  were  not  just  the  high-cost, 
hlgldy  capable  platforms  such  as  the  F  1 5 
and  F-1I7A.  The  new  generation  of 
precision  guided  munitions  (PGM) 
recorded  the  most  spectacular  successes. 
Also,  the  A-IOA.  designed  as  a  low-cost 
specialized  aircraft,  performed  very 
well.^*’ 

TTie  future  direction  of  military  tech¬ 
nology  will  not  necessarily  favor  the  cur¬ 
rent  emphasis  on  Individual  system 
performance.  Even  low-cost,  perhaps 
unmanned,  systems  can  carry  highly 
soph  -dlcated  PGMs.  In  the  air-to-air 
arena,  the  F-16's  ability  to  carry  the 
launch-and -leave  advanced  medium- 
range  air-to-air  missile  (AMRAAM)  may 


j  n'duci’  dilierences  in  ellei  t  I'.ent  ss  witii 
I  the  F- 1  b  .'itid  ihe  advain  ed  tai  tii  .d 
i  tlghler.  AMiGAAM  may,  in  la'  !,  till  all 
I  .vealhci  all  to  air  i  oniliat  resnh  to  lavoi 
Ihe  side  with  numtx-rs,  Advam  ihI  heal 
1  seeking  mssslles  caused  similar  results  iii 
!  close-in  ilav  visn  d  ilighi  rides  (VFK)  coni 
I  bat,  as  shown  in  Ihe  air  combat  evalua 
j  tkm/air  inlerie(it  missile  evaluation 

i  (AGEV'AL/AI MVAL)  test  scries.  ’^ 

I  In  a  hroaiier  sense,  the  future  "f 
!  imalar\>  lechnologv  appears  to  lie  .n  the 
j  integrated  hallleneld,  or,  lo  use  a  .Soviet 
I  term,  in  reconnm.ssance  .siriki’ coni/if.  .ve.s 
j  *KliK).  '^  Sensor  complexes  (satellites. 

I  leconnalssance  liet  cej  aircralt.  Airborne 
I  Warning  nd  Control  System  (AWACSl. 

I  ami  Joint  Surveillance  larget  Altai  k 
i  Radar  System  (J-S'EARSl)  quickly  assess 
I  ihe  operational  situation.  Modem  com¬ 
munications  rapidly  link  scirsors,  c'-m- 
mand  centers,  and  combat  units.  PGMs 
are  qui'kly  and  lethally  allocated  to 
enemy  targets.  The  Desert  Slonn  opera¬ 
tion  Is  possibly  I’le  first  credibly  opera¬ 
tional  RUK  In  actual  combaC^ 

The  implications  of  Ihe  integrated 
baltlelleld  arguably  Include  the  potential 
for  cheaper,  less  capable  systenvs  within 
file  integrated  complex  (RUK).  For  ex¬ 
ample.  cenU  al  sensor  systems  plus  com- 
munications  could  p' ovide  the 
situational  awareness  tliat  wc  nowexpec  t 
from  on  board  components.  Tlie  global 
I  positioning  system  (GPS)  reduces  the 

I  need  for  high-perfomiance  navigational 

1  systems  aboard  individual  platlorms. 

ddie  critics  are  unlikely  to  miss  these  or 
similar  arguments. 

Wliafs  said  here  alxnil  RUKs  is  some¬ 
what  speculative.  It  is  not  speculative, 
however,  lo  predict  that  defense  needs 
will  be  underfundetl  in  the  years  ahead — 
behavior  fully  consislenl  with  jiast 
I  periods  when  no  major  military  lineal 

posed  a  clear  and  present  danger  to  vital 
national  inleiesis.  With  ap|>rop!iale<! 
funds  never  meeting  planning  forecasts, 
purchases  of  new  equipment  will  he 
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decreased,  and  force  planning  will  suf¬ 
fer.*  In  those  circumstances,  design  op¬ 
tions  that  allow  for  larger  numbers  to  be 
purchased  will  appear  more  attractive. 
And.  a  vocal  group  of  advocates  Is  In  place 
to  make  the  case  to  our  national  leader¬ 
ship.^' 

This  discussion  Is  tlierefore  organized 
as  part  of  an  ongoing  debate  regarding 


cost  and  peiiornmnce  In  iiia)or  weapon 
systems.  It  begins  wlLli  the  critics'  posi¬ 
tion.  assesses  the  emplrfcr,!  rir^ird  using 
cost  and  performance  data  for  US  tactical 
aircraft,  and  Onally.  olTers  some  thoughts 
on  cost  and  performance  trade-oQs  in  the 
post-cold  war  period. 
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Chapter  2 


The  Conventional  View  of 
Cost-Performance  Choices 


THIS  chapter  could  be  titled  "the  gadget- 
1  la  ppy  nillltaiy . "  Tlie  most  commonly  Ijeld 
beliel  (the  “conventional  wisdom")  regard¬ 
ing  quality  versus  quantity  choices  Is  that 
the  major  weapon  systems  are  laden  wltli 
technological  bells  and  whistles  that  add 
much  to  cost  but  little.  If  anything,  to 
military  efTecllveness.  This  is  a  summary 
of  that  position,  without  a  complete  sur¬ 
vey  or  extensive  critique. 

The  conventional  wisdom  position  has 
an  extraordinarily  wide  following.  Advo¬ 
cates  Include  an  industrial  leader  like 
Norman  Augustine,  Washington  analysts 
like  William  McNaugher  and  Chuck 
Spinney,  as  well  as  a  more  Ideological 
critic  like  Mary  Kaldor.' 

One  can  simply  state  that  military 
hardware  is  “gold  plated"  and  not  expect 
to  oQ'er  much  justillcatlon.  even  In  the 
Pentagon.  Asserting  that  military 
hardware  Is  designed  through  conscious 
choices  balancing  increments  In  cost  and 
perlbrmance  in  the  interest  of  mllitaiy' 
etfectiveness  is  likely  to  be  c  ontroversial 
virtually  anywhere.  Tlierelore,  whether 
ot  not  oiu*  ut^lieves  tlie  crlUcs.  it  is  impor¬ 
tant  to  understand  their  positions. 

The  Flawed  Process 

The  conventional  wisdom  concerns  It¬ 
self  with  analyses  of  ihe  acquisition 
process,  with  less  attention  to  results. 
Procurement  of  military  hardware  serves 


at  least  three  masters:  technical, 
military,  and  political.^  The  process  pur¬ 
sues  at  least  three  sets  of  Inconsistent 
goals  with  the  various  players  assessing 
dliferent  priorities. 

Developing  and  producing  military 
equipment  has  become  routlnlzed  and 
bureaucratized.  The  industrial  concerns 
involved  constitute  a  remarkably  stable 
group.'  Tlie  major  government  players 
Include  die  services  (with  using  com¬ 
mands,  research  and  development  (RAD) 
agencies,  and  service  staffs);  the 
secretary  of  defense  (and  stall  agencies): 
various  (and  increasingly  numerous)  con¬ 
gressional  conunitlees,  subcommittees, 
and  support  agencies  (including  the 
General  Accounting  Office,  the  Congres¬ 
sional  Budget  OlTlce,  and  the  Congres¬ 
sional  Research  Ser\1ce);  and  (more 
recently)  the  Joint  Stall.^ 

Each  agency  has  its  owm  agenda  and 
many  avenues  to  pursue  it.  A  player  that 
has  lost  in  one  fomm  may  “appeal"  to 
others.  Including  the  federal  courts  and 
the  press.  The  multiplicity  oi  interesterl 
parlies,  objectives,  and  decision  arenas 
encourages  contentious  and  strategic  bf»- 
fiavlor:  most  agree  that  the  process  is 
adversarial.’ 

The  process  itself,  theiefore,  obscures 
the  question  of  whether  we  are  designing 
and  fielding  cost -eflect ive  militarv  equip¬ 
ment.  No  one  takes  specific  exception  to 
cost-efiectiveness,  but  It  is  only  one  of 
many  objectives  those  involved  pursue. 
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The  Technological  Imperative 

The  United  States  is  conunltted  to  su¬ 
periority  in  both  basic  nillitaiy  teeti- 
nologies  and  fielded  systems — tor  good 
reason.*’  We  have  a  competllive  ad- 
canlagc*  in  our  ability  to  develop  sopfils- 
ticated.  high-performance  weapon 
.systems.  We  compensate  tor  oui  imwill 
ingness  to  put  large  numbers  of  pcsiple  In 
fiann's  way  and  accepting  large  numbers 
of  casualties  with  advantages  in  lechnol 
ogy.  We  tbink  in  terms  ol  lighting  out¬ 
numbered. 

The  <'(-nventlO!ial  wi.sdom  i  tiarges  that 
we've  taken  ernptiasis  cn  lecliindogj'  to 
e.xtremes.  We  add  gadgets  fliat  ate  unre¬ 
lated  to  military'  etfcctJvcness  for  reasons 
endemic  to  ttie  way  we  do  business.' 
Typically,  we  buy  new  systems  as  techni¬ 
cal  improv'einents  instead  of  replacing 
worn-out  e<iuipment.  More  than  one  in- 
dustiial  concern  is  able  to  develop  and 
nuinufacture  equipment  enibodying  the 
new  technologies.  Ttierefore.  contractor 
comjietilion  emptiasizes  tectmica*  fea¬ 
tures.  with  optimistic  p.’-ouoses  ab<MH 
costs  and  risks.'* 

Oflicials.  niilitary  and  l  ivilian.  most 
directly  involved  wilii  tjie  nev'  system 
pre.ser\'e  that  optimtsm.  lievond  ttie  en¬ 
thusiasm  normal  tcj  the  eariv  stages  ot 
any  new  project,  ttiey  have  a  Him  t^eliet  in 
the  military  efUcacy  of  the  iechnologi' s 
being  pursued.  And.  a.s  practiced 
bureaucrats.  Ltiey  know  what  it  takes  to 
form  the  coalitions  needed  to  sustain  the 
program  throughcjut  the  protracted 
development  and  production  process. 
Tliey  are  awnre  of  the  important  e  of  a 
consensus  among  Interests  and  con¬ 
stituencies  within  one  s  service,  in 
Department  of  Defense  (DOD),  and  on 
Capitol  Hill. 

Building  coalitions  inevitably  retjuires 
compromise,  often  in  the  Ibrm  ol  atiding 
someone  else’s  favorite  gadget  to  tlie  sys¬ 
tem  specttlcaflons.'”  In  the  optimism  of 
tlie  early  stages,  that  is  easy  to  tlo.  Ihere 


lore,  new  systems  inherently  start  with 
overspecified  rcfjuirements  (buiden  of 
consensus)  and  too  little  funding  (Imnlen 
ol  optimism). ' ' 

To  niitke  nuillers  worse,  the  new  sys¬ 
tem  Is  rushetl  toward  piodui  tlcin.  mini 
mi/ing  the  time  available  to  test  the 
design  s  |ii  act  U  ality  and  to  correct  Haws 
at  a  modest  cost.  This  prat  t ice  niiikes 
eiiiinently  good  sense  to  the  players  in 
volvetl.  Technology  im  vitahly  flitliises 
and  a  nation  committed  to  lechniial  so 
peiioritv  cannot  allord  to  dither  alioiil 
exploiting  its  technical  advantages 
Moietwer.  the  sttoner  the  system  reat'hes 
ptodiK  lion  and  (it  ployinent,  the  less  lime 
the  supporting  loalitlon  neeils  |f>  lir>ld 
together.''* 

The  process  therefore  dictates  that 
dtnelopmenl  and  procurement  ol  military 
hardware  |)roceed  with  little  or  no  refer¬ 
ence  to  the  cost -quality  trade-oils.  Tlie 
combined  Itnrdens  of  consensus,  op¬ 
timism,  and  overspecification  mean 
gadgets  addeii  for  reasons  unrelated  to 
operational  utility. 

Technology  versus  Innovation 
and  Effectiveness 

HK  (piesi  lor  teclinolog\'  is  not  th'* 
sank  as  a  commitment  to  iimovatiot).  in 
tact,  tlie  ticguisilion  estabiistimeiil  ollcn 
oppc^ses  tnic  innfivation.  Alicr  tlx  start 
of  development,  the  contra,  lot  must  work 
witiiinan  extensive  list  ot  “requirement  s," 
m.my  r>f  which  prei  liide  new  means  ol 
designing  and  producing  an  effective 
military  svsteni."  Coalition  building  re¬ 
quires  incot |x>raling  established  maliire 
technologies  with  the  bureaucratic  su[) 
port  Riidically  new  technologies  lend  tint 
to  have  strong  backers  and  are  Ihereloi  p 
written  out  of  the  system  sjreellu  ations  ' ' 

As  a  result,  we  demand  large  improve 
nienls  In  jrerlbnnance,  and  w'e  rely  on 
mature  (some  say  “decadent")  tech- 
no)ogles,  from  which  inciemenis  of  per- 
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torrnance  are  available  only  at  ver^'  higli  i 
cost.''*  Facing  shaiply  restrlctetl  techni-  ^ 
cal  choices  and  expected  to  live  within  1 
optimistic  cost  estimates,  the  contractors  ! 
and  program  tiumagers  Inevitably  devote  j 
most  of  their  etforts  to  satisfying  tlie  per-  | 
forraance  goals.'**  However,  there  is  no  j 
free  lunch;  the  costs  associated  with  the  ! 
technological  imperative  are  Increasetl  | 

('omplexlty,  lower  reliability,  liigh  main-  j 

tcnance  costs,  ami  inaderpiate  numbers 
of  weapons  purchased.'^  i 

Gadgets  specified  at  conception  pins  j 

otficr  gadgets  added  during  development  j 

maki  our  weapon  systems  liighly  com- 
;>lc\-  -tlie  ''f)aro(}ue"  arsenal.'**  In  ojx;ra-  ! 
bun.ii  use,  complex  systems  me  likely  to  i 
break,  are  dillicull  to  repair,  and  gener¬ 
ally  expensive  to  maintain,  lliey  'n 
fierently  unready  for  combat.'^ 

Therefore,  die  quest  for  performance  is  ! 
not  consistent  with  designing  for  military 
etiei  liveness.  Some  critics  c  harge  that  j 
the  performance  increments  are  not  i 

worth  the  extra  costs.  Some  go  liulhei  i 
and  assert  diat  extra  comple.xity  .Tlually  j 
reduces  (he  ellectiveness  of  individual 
units.  ; 

I 

I’he  comcntional  wisdom  concludes  j 

the  acqui si: i.)n  process  vorks  badly.  The  ' 
UK  s(  noteworthy  successes  ocour  outside  i 
t!i<' usual  channels.  The  critics  stale,  for  j 
cxau'.ple  that  we  have  the  F-lh  only  be-  | 

f  a  use  non  Icaderstiip  did  not  (otlovv  es-  i 
tnb’.i.shed  Air  Force  proc'edures.'"  ' 


A  Preliminary  Assessment 

One  c:an  find  fault  with  die  conven¬ 
tional  wisdom.  First,  die  critics  haven’t 
always  been  careful  with  their  argu¬ 
ments.  When  it  comes  to  specific  cases, 
what  constitutes  a  gold-plated,  baroque 
design  is  often  rague,  or  at  least  subject 
to  differing  interpretations.  For  example. 
Kaldor  cites  the  Inability  of  Pakistani 


F-  104s  to  efferliv'ch'  engage  low-altilude. 
subsonic  Indian  aircraft  (Gnats)  in  1965 
as  clear  cut  evidence  of  die  deficient  }X“r- 
fonnatice  of  high-jierformaru  e,  iiudtl- 
mlsston.  banxjue  weapons  Actuallv 
diere  is  a  strong  case  for  die  F'  101  nut 
being  a  inuitimission  aircraft  Tlu‘ 
original  design  envisioned  a  higli- 
ailitucJe.  super.so’iic  interceptor.  A  lia 
locpie  system  would  have  includt-i.1  lowei 
altitude  engagements  in  its  specific  atic. ns 
and  wotdcl  have  performed  bett,‘’r  against 
the  Indian  aircraft.^’ 

Ijkewise  the  issue  ol  gold  plaling  and 
complexity  is  clouded  in  the  c.tsc  ol  the 
F-86-  the  favorite  of  many  ciiiics  who 
cite  its  conspicious  successes  in  Korea 
and  in  tlie  1971  w'ar  betw-een  India  and 
Pakistan  and  tout  it  as  the  "last  great 
fighter  built  by  the  Enited  States,"^’ 
However,  added  gadgets,  complexity, 
grow’th  111  g.''os,s  weight,  aud  low 
availability  U.r  combat  plagued  the  F-86 
In  Us  early  years. it  appears  dial  the 
crllJcs'  good  exam,  ■'hare  the  problems 
of  tlieir  bad  eauimples. 

Murray  L  W’eldenbaum  uses  c.vtern -I 
ecjuip'/iicnt  c  luttering  clean  ac  :d\  nami. 
ilesi^is  as  proof  of  gold  jilal  irig.'*’  A< 
tiially.  most  c*xternal  eqiiipmcvU  is  added 
as  part  ol  modifying  ecpiipmenl  in 
scrvic'e — someliiing  most  c.  itics  a.s.seH  Is 
not  done  often  eiiougli,^* 

The  store, f  sometimes  does  mo!  icack 
well.  For  exampie,  Kiddor  lakes  pains  to 
dilferenUale  the  Soviets'  “conspiA'ativ-’ 
approach  to  weapon  design  with  the  h  i 
rocpie  Western  approach.  **  Sin  i 
Western  metliods  are  argued  to  lessen 
military  effectiveness,  one  would  exiiect 
the  Soviets  to  be  ahead  In  tlie  military 
c’omjietition.  Instead.  Kaldor  stales  that 
the  W’est  has  eonsistendy  held  die  Initia¬ 
tive  in  the  arms  race* — witJi  the  Soviets 
doggedly  trying  to  keep  pace.^  (t  is  dif- 
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ticiilt  to  reconcile  those  two  assertions, 
especidily  when  ottered  toj^ether. 

Second,  experience  disproves  many 
propositions  tlie  critics  otter.  Kiildor 
predlctetl  in  1981  that  electronic  innova¬ 
tions  (e.g.,  PGMs)  would  receive  insufll- 
cient  attention  because  ot  preoccupation 
with  the  older  (decadent)  technologies  as¬ 
sociated  with  the  aircratt  and  automotive 
industries."’  Tliat  statement  is  at  odds 
with  McNaugher  s  well-documented  con¬ 
tention  that  the  services  pursued  tlie 
Maverick  (a  PGM  by  any  definition)  with 
too  much  entliusiasm  and  haste.  ” 

Anf'ther  example  is  SpLnney's  predic¬ 
tion  that  fighters  like  the  F-lb  simply 
can’t  generate  sorties  in  anything  resem¬ 
bling  the  amounts  predicted  in  war 
plans. Field  tests  with  F-l.'Ss  liave 
demonstrated  ability  to  meet  or  exceed 
the  sortie  rates  specified  in  the  war  plans. 
Similar  results  oci  iiiTed  in  tlie  Gulf  war.  ” 


Conclusions  Regarding  the 
Conventional  Wisdom 

HERE  are  tnree  keys  to  undei  stiuiding 
the  conventional  wisdom.  First,  it  is  well 
entrenched  in  popular  beliefs.  Most 
people  believe  that  military  hardw'are  is 
developed  and  procured  witliout  regard  to 
cost,  that  gold  plating  is  simply  a  part  of 
the  way  the  military  works.  Second,  the 
critics  are  not  perfect.  Many  parts  of  their 
arguments  do  not  withstand  ('lose  e.x- 
amlnation.  Finally,  even  with  Irnpertec- 
lions.  It  is  difficult  to  comprehenslveK’ 
refute  tfie  conventional  wisdom.  Tlie 
critics  aim  most  of  their  fire  at  the  ac- 
(piisition  process.  Taking  tliem  on  point 
by  point  means  defending  an  imjx'rfer  l 
process,  which  most  agree  is  not  defen¬ 
sible  in  every  detail. 
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Chapter  3 


The  Empirical  Record 

The  Case  of  US  Tactical  Air 


THE  proof  is  In  the  pudding,  ami  die  ! 
worth  is  in  the  output.  Althon(<h  tnueh  j 
attention  has  been  df  voted  to  Haws  in  the  ■ 
arcpdsltion  process,  the  conventional 
wisdom  has  ajmm'tted  less  effort  to  as 
sessinj^  the  outcomes.  This  cfiapter  uses 
US  tactical  air  as  a  case  study  to  assess 
the  outcome  of  the  acquisition  fjroce.ss 

Unit  costs  of  major  weapon  systems  1 
have  increased — a  well-publicized  and 
acknowledged  fact.  Tlie  performance  and 
combat  capabillUes  of  major  weapon  sys¬ 
tems  have  also  Increased,  a  fad  less 
publicized  and  acknowledged.  Two  ex-  ■ 

amples  illustrate  the  latter  point.  One  j 

squadron  of  F-15s  could  easily  have  ; 

replaced  the  entire  boml.'cr  force  com-  j 

mitted  against  Schwelnfurt  tn  October  ! 

1943 — penetrating  contemporary  air  | 

delenses,  achieving  the  same  level  of  j 

damage,  and  taking  fewer  casualties.'  j 

Mat  Hajovood  S.  Hansell  (who  did 
much  to  iomiulate  tlie  .strategic  bombirg 
campaitrns  of  World  War  It)  staled  that 
one  contemporary  heavy'  bomber  (B- 1  or 
B-2)  is  worth  more  than  one  tiundretl 
heavy  bombers  of  World  War  [I  vintage, 
even  against  modem  air  defenses.^ 

Many  who  hold  to  the  conventional 
wisdom  would  not  disagree  fundamen¬ 
tally  with  those  estimates  of  capability 
increase.  They  would  assert  that  in¬ 
creases  in  performance  reflect  pursuit  of 
technological  possibilities  without  con¬ 
sideration  of  the  cost  implications.  ■ 

Fortunately,  the  question  of  what,  if 
any,  cost- performance  trade-offs  ailed 
system  designs  is  amenable  to  some  em¬ 


pirical  verification.  rheAiialv'ic  S(  jein  os 
Corporation  (TA.SC)  has  develope^l  an  ca 
tensive  data  base  irJating  inissl'Ui 
<  apabilily  l<>  cost  of  U.S  tactical  aiici.di  ,' 
A  Itiind  aitalv.sis  oi  that  data  has  s{-,ed 
considerable  light  on  the  facff)rs  acc  fnint 
ing  kii  cost  f)f  tactical  aircraft  .  '  Build'cig 
on  those  studies  we  c:tn  subject  v.irious 
jtroposilions  about  major  weaixin  system 
cost  and  perfomumce  to  empirical  test  — 
using  US  tactical  aircraft  a*'  a.  tase  lor 
study. 

Empirical  Implications  of  the 
Conventional  Wisdom 

PREFERRING  back  to  <  haptei  2.  we  ran 
state  several  eminrical  propo-Mti  iis  con¬ 
sistent  wItJi  the  convep.tiona':  .•,\  (lt)m 

1.  Unit  « f)st  is  growing  rapidly  in  real 
(erms,  even  niter  lower  production  rotes 
are  taken  into  a»  c  ount."’ 

2.  Tlie  pursuit  of  higher  perlorniarive 
has  led  to  lewer  aii  craft  being  produced.' 

3.  V/e  are  Ihorouglily  locked  into  nuc 
ture.  “decadent”  ler  hnologies;  that  is, 
cost,  perfomiance.  and  ruunlKns  of  mis¬ 
sions  are  growing  over  time.' 

4.  Increased  performance  comes  at  a 
very  high  cost 

b.  Perlormance  requirements  an' 
pushed  to  the  edge  of  current  ly  available 
technology.  There  is  no  systeniiitic  trade¬ 
off  between  irertormairce  and  cost:  com- 
ple.xity  and  “gold  plating"  are  iricTeasing. ' 

Tire  first  three  propositions  can  be  e.x- 
amlned  readily'  wllli  the  available  data. 
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I^ovtng  or  disproving  proposition  4  re¬ 
quires  a  model  to  account  for  the  cost  of 
tactical  aircraft.  Proposition  5  is  the  most 
serious  indictment  of  current  practices 
imd  is  tlie  centerpiece  of  the  conventional 
wisdom.  Examination  of  this  last 
proposition  requires  a  model  for  analyz¬ 
ing  cost-performance  trade-offs. 

This  section  first  examines  proposi¬ 
tions  1  through  3.  Next,  it  provides  an 
ex]ilanatory  model  to  account  for  aircraft 
cost  that  serves  as  a  means  to  evaluate 
proposition  4.  A  rational  design  model  is 
then  oflered  as  a  benchmark  for  examin¬ 
ing  actual  cost-performance  trade-ofls. 
Taken  together,  the  empirical  and  ratio¬ 
nal  design  models  provide  a  means  for 
assessing  tlie  merits  of  proposition  5. 


Trends  in  Tactical  Aircraft 
Cost  and  Performance 

Proposition  l  asserts  a  clear  trend 
toward  Increasing  costs  in  major  weapon 
systems.  Jacques  Gansler  puts  the  in¬ 
crease  at  5  to  7  percent  per  year,  even 
after  taking  inflation  and  production 
rates  into  account.'”  At  face  value,  tacti¬ 
cal  aircraft  data  supports  Gansler’s  state¬ 
ment.  If  we  exclude  the  effects  of 
production  rate,  we  note  then  real  unit 
cost  has  grown  at  approximately  6  per¬ 
cent  per  year,"  Figure  1  plots  real  unit 
cost  (corrected  for  production  rates)  with 
respect  to  time.  However,  if  we  also  cor¬ 
rect  for  the  effects  of  peiibrmance,  tlien 
the  time  trend  disappears — which  casts 
considerable  doubt  on  the  significance  of 
Gansler’s  statement.'^  This  is  evident  in 
figure  2. 

Proposition  2  states  that  production 
rates  have  decreased  over  time,  with  the 
pursuit  of  higher  performance  being  a  key 
factor.  The  empirical  evidence  supports 
that  hypothesis.  In  fact,  there  is  a  clear 
downward  trend  over  time,  even  after  the 
effects  of  wars  (Korean  and  Vietnam)  and 
performance  have  been  Included,  as  Qg- 
ure  3  shows."* 


< 


O 


19-10  1950  1000  loro 

YEAR  OF  i  IMS  I  f  I  lOH  F 


Figure  1 


I  Figure  2 

i 

I  Commitment  to  mature  technologies 
!  means  pursuit  of  ever-higher  perfor¬ 

mance  and  multimission  capabilities 
;  despite  very  higli  costs,  and  the  increas¬ 
ingly  higlier  cost  of  more  performance.'^ 
Proposition  3  therefore  asserts  that  we 
observe  higlier  performance,  higher  cost, 
and  greater  tenrlency  to  mullimission 
designs.  Virtually  all  observers  would 
agree  with  the  higher  costs  and 
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capabilities  over  time.  There  is  also  some 
evidence  for  designing  more  missions  into 
tactical  aircraft,  as  shown  in  figure  4. 


1940  1950  I960  1970  1980 

YEAR  OF  FIRST  FLIGHT 


Figure  3 


Accounting  for  Tactical 
Fighter  Costs 

T HE  work  of  Gregory  C.  Hlldebrandt  and 
Man-bing  Sze  provides  the  basis  for  ex¬ 
plaining  tactical  fighter  costs — using  the 


TASC  data  and  taking  into  account  con¬ 
ditions  of  production  (to  Include  crests  of 
materials  and  learning  curves),  perlrjr- 
mance,  and  mission  design/'^  Tlie  follow¬ 
ing  model  explains  tactical  aircraft  cost; 

C=  .959  lql>  -^l  [ti  37imoi>1|  [Ratei  >  «l| 

(  .IWI  (13.65)  (  2  93)  (2.92) 

[(4  34SAI)|  [j4  03()| 

i2»si  (;i.  I) 

where  C  is  real  unit  cost  (in  millions  of 
fiscal  year  1981  dollars),  q  is  performance 
as  measured  by  the  TASC  methodology, 
R  is  production  rate,  MOD  and  A1  are 
dummy  variables  (taking  on  the  value  one 
for  modified  aircraft  and  interceptors, 
respectively).  The  eflect  of  time  (t)  start¬ 
ing  at  1950  (where  t  =  1)  is  estimated 
exogenously,  using  the  Hlldebrandt  and 
Szjt  estimate  of  technical  progress.'"  All 
estimated  coefficients  are  statist  ically  sig¬ 
nificant  except  the  constant. 

Using  the  empirical  model,  we  can  now 
comment  on  proposition  4.  Norman  R. 
Augustine  asserts  that  the  last  10  percent 
in  performance  accounts  for  about  one- 
third  of  the  cost:  Walter  Kross  quotes  the 
critics  as  staUng  the  last  10  percent  ac¬ 
counts  for  about  half  of  total  cost.'^  Ac¬ 
cording  to  model  (3.1),  we  would  expect 
the  last  10  percent  of  performance  to 
account  for  approximately  1 3  percent  of 
total  cost,'"  much  less  than  the  amounts 
the  critics  have  claimed. 


A  Rational  Choice  Model  of 
Cost-Performance  Trade-offs 


Inherent  in  any  system  design  is  a 
trade-otf  between  performance  and  cost. 
The  opportunity  cost  of  better  jjerfor- 
mance  is  the  added  quantity  possible 
witli  a  cheaper,  less  capable  design.  Also, 
combat  eft'ectlveness  is  a  function  of  both 
quantities  available  and  capabilities  of 
each  unit.'®  A  military  service  Interested 
only  tn  maximizing  capabilities  would 
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trade  ott  perlbrniance  agaliist  cost  to  lor 
iTiulale  the  design  that  provides  the 
laigesi  amount  of  capability  for  a  given 
budget.^  The  design  problem  is  depicted 
graphically  in  llgure  b.  At  any  given  level 
of  teclmology,  T.  perfomumce  comes  at  a 
price  described  by  the  performance-cost 
frontier,  AA.^'  Thereff)re,  the  serv'ice 
faces  file  choice  between  fewer  but  more 
capable  aircraft,  or  more  numerous  but 
less  capable  aircraft,  as  depicted  in  figure 
6.  The  curve  IJB  represents  budget  con¬ 
straint  of  the  lonn 

»=  lC(q)|  w. 

where  C  is  average  unit  cost  as  a  function 
of  performance  (q)  and  x  is  number 
procured.  The  curv'e  BB'  represents  an 
increase  in  available  resources.  The 
curve  EE  represents  combinations  of  per¬ 
formance  and  quantity  that  result  in 
equal  levels  of  eftectiveness  (an  Isoquant): 
FF  represents  an  increase  in  effective¬ 
ness,  while  DD  constitutes  a  decrease. 
The  optlmuin  design,  q*.  occurs  at  a  point 
of  tangency  between  the  Isoquant.  EE. 
and  tlie  budget  constraint,  BB.  At  that 
point,  the  slope  of  the  budget  line  is  equal 
to  the  slope  cf  the  Isoquant. 
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Figure  5 
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Figure  6 

The  implications  of  tangency  are  im 
portant.  Suppose,  as  Frederick  L.  Froslic 
and  others  state,  dial  combat  elfeclive- 
ness  is  a  multiplicative  relationship  of 
quantity  available  and  individual  system 
capabilities,  such  as. 

R=  cf'x, 

where  R is  ellectiveness,  q  is  performance, 
and  xls  number  available. TTie  slope  of 
the  Isoquant  is 

dq/ dx  =  -  q/ax. 

Likewise,  the  slope  of  the  budget  line  is 

dq/dx=~  c/c^. 

where  is  the  first  partial  derivative  ol  C 
with  respect  to  q.  Since  tlie  slojres  are 
equal,  then 

qC:,/C=a.M  (3.2) 

Equation  (3.2)  characterizes  a  rational 
design  that  balances  performance 
against  cost  to  obtain  the  greatest  pos¬ 
sible  combat  capability.  As  already 
shown  in  the  empirical  model,  we  can 
relate  performance  and  cost  as  follows  (if 
ail  other  variables  are  held  constant): 

C=I.Sol  IqS,). 
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where  S,^  includes  the  (constant)  values  ol 
all  variables  except  q.  We  can  then  relate 
the  empirical  model  (3.1)  to  the  rational 
deslj^n  model: 

or,  ((<■',/ =  ‘^1 

Combining*  (3.2)  and  (3.3)  gives  ns 

s,  =  a  (:r4) 

Equation  (3.4)  provides  a  crucial  In¬ 
sight.  F^itional  choice  in  systems  design 
means  that  the  assessed  relative  irnpoi- 
tance  of  performance  and  numliers  is 
revealed  In  the  parameter  S,.  which  can 
f^e  engiincally  estimated.  Tliis  suggests 
two  observations.  First,  since  S|>1.  the 
empirical  record  shows  a  clear  preference 
for  peribrmance  over  quantity. Second, 
we  can  formulate  an  alternative 
hypothesis  to  proposition  5. 

5. a.  Tar  tlcal  .airtTHfl  designs  reflect  a  .systematU 
and  consistent  trade  olT  between  performanre 
and  cost. 

If  true,  proposition  5. a  falsifies  5.  If 
proposition  5. a  were  not  true,  we  would 
e.xpect  to  llnd  the  estimated  parameters 
of  model  (3.1)  to  lie  of  doubtful  sig¬ 
nificance.  We  would  also  expect  to  find 
tlie  overall  model  to  be  of  dubious  value 
in  explaining  cost  variances. “  If,  as 
proposition  5  asserts,  weapon  system 
designs  are  becoming  increasingly  ba¬ 
roque  or  gold  plated,  we  would  expect  to 
find  some  evidence  of  changes  in  behavior 
over  time,  with  the  estimated  value  for  S, 
increaslng.^*^  There  is  good  evidence  of  a 
change  in  the  overall  model  taking  place 
for  designs  that  first  flew  in  1957  or  later; 
the  model  applied  to  the  two  subsets  gives 
results  as  follows; 

first  lligfit  belbre  1957, 

C=  .fJ07  |ql>  15«)|  .287MOl)|j  '7«ll 

t  .13)  (5.69)  (1.08)  (  1.62) 

|e(.414A))|  P-  03t] 


first  ilighl  19.57  or  aitci  , 

r  =  2.n4  !<}<' "’-'ll  H  'i)  iiiAic:'  '‘"'i 

(I  50)  11  >  -18)  1  /  i.';  I  j  «<) 

j,.(2/OAI)|  (,,  aif| 

*  *  -'’I 

Analysis  oi  the  data  indif’atcs  that  ob- 
seiA’ed  preterence  for  peiiormance  has 
not  changed  over  tlme.'^  In  short,  the 
empirical  rec'ord  for  tactual  aircraft  is 
consistent  witli  the  rational  choice  model 

Assessment  of  the  Empirical 
Record 

Two  findings  are  by  lar  the  most  inter¬ 
esting  and  important.  First,  the  seixices 
have  clearly  favored  perlorimmce  ovei 
quantity:  or.  restated  in  terms  of  the  ra¬ 
tional  design  model,  the  services  have 
revealed  an  assessment  showing  peiior- 
maiu'e  to  be  more  important  than  num¬ 
bers  in  tactical  air  combat.  Second, 
observed  behavior  is  consistent  with  the 
rational  design  model;  there  is  strong 
evidence  to  support  tlie  proposition  (5.a) 
that  system  designs  cxrnsistentK'  relied 
an  assessment  ol  the  roles  of  system  per¬ 
formance  and  numbers  in  producing 
combat  effectiveness. 

Idle  second  finding  provides  a  new 
perspective  for  viewing  the  conventional 
wisdom  (es|jecially  in  propositions  1-4). 
Tlie  critics  appear  to  be  reasonably  ac¬ 
curate  observers,  but  not  profound 
analysts.  In  fact,  the  more  danuilng  the 
assertion  offered,  the  less  the  empirical 
record  supports  It.  Propositions  1,2,  and 
3  are  factual,  althougli  the  conclusions 
drawn  are  sensitive  to  the  induslon  ol 
other  explanatory  variables  beyond  the 
simple  passage  of  time. 

FYoposition  4  is,  at  minimum,  an  exag¬ 
geration.  Increased  peribrmance  does  in¬ 
deed  carry  a  price  tag;  but.  it  is  far  less 
tlian  asserted.  Finally,  if  one  accepts 
proposition  5. a,  then  propositions  1-4  fall 
the  “so  what"  test.  Higher  perlbrrnance 
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(along  with  liigher  costs  and  lower  num¬ 
bers)  Is  Justified  based  on  military  cal¬ 
culations  of  combat  effectiveness. “ 

So,  what  are  tlie  real  Issues?  First  Is 
military  competence  and  integrity.  The 
pertbrmance  measures  used  rely  heavily 
on  professional  military  judgments.^® 
Paid  consultants  to  the  DOD  (a  sig¬ 
nificant  number  of  whom  are  retired  of¬ 
ficers)  compileri  all  the  data  used  here. 
Althotigh  there  appears  to  be  no  ulterior 
objectives  In  tlie  woik  cited,  those  deter¬ 
mined  to  distrust  the  military  or  depre¬ 
cate  military  expertise  will  dlstixist  or 
deprecate  the  analysis  presented. 
Second  is  the  real  importance  of  system 


pertonnance  versus  numbers  in  deter- 
niin'ag  military'  effectiveness.  Thoufth 
the  military  has  shown  a  consistent  as¬ 
sessment  In  favor  of  perfomiimcc.  imm\' 
would  argue  tliat  numbers  are  more  im- 
jwrfant.  St)me  cite  the  ACEVAIVAIMVA... 
test  series  as  proof  of  the  greater  etlef  tive- 
ness  of  larger  numbers  of  cheaper 
simpler  air-to-air  fighters.**’  Likewise, 
the  importance  of  a  regular  “presenc  e" 
over  the  battlefield  (achievable  lhroi;^i 
large  numbers)  has  l>een  used  to  supp<^ii 
the  contention  tliat  nuintx*rs  are  also 
more  Important  In  air-to-ground  mis 
sions.^' 
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Chapter  4 


Cost-Performance  Choices  in  the  Future 


TO  ensure  that  we  field  cost-efiective 
hardware  in  the  fiscally  constrained  years 
ahead,  it  is  useiul  to  think  thro  iifh  the 
Air  Force  approach  to  quality-quantity 
trade-oils.  At  minimum,  it  is  highly  ad¬ 
vantageous  to  better  articulate  the 
reasons  lor  current  practices.  Chapiter  2 
Indicated  some  dlfUculty  discerning 
where  those  trade-oils  are  actually  nude 
in  the  acquisition  process.  However, 
chapter  3  showed  substantial  evidence 
lor  truijor  weapon  .system  designs  Ibllow- 
tng  a  consistent,  ratloiuil  pattern  of  cost- 
performance  trade-offs.  Tliis  chapter 
addresses  two  Issues.  First,  does  the  em¬ 
pirical  evidence  suppcrt  past  assess¬ 
ments  of  performance  being  more 
im[x>rtanl  than  quantltv'?  Some  evidence 
based  on  Lanchestrian  models  of  combat 
results  supports  file  assessment  that 
quality  is  more  important  tJian  numbers.' 
Second,  with  the  Central  Front  contin¬ 
gency  no  longer  dominating  defense  plan¬ 
ning.  how  will  the  quantity-performance 
issue  play  out  in  a  world  of  multiple  and 
uncertain  contingencies?^  Portfolio 
theory'  provides  Interesting  insights,  with 
indications  that  we  should  continue  em¬ 
phasis  on  performance  in  the  future. 

Relative  Importance  of  Quality 
and  Quantity  in  Coinbat 

C^HAPTER  3  discussed  multiplicative  ef¬ 
fectiveness  measures  of  the  form 

R=q^x,  (4.1) 

where  R  is  combat  capability,  q  is  system 
performance,  xls  numbers  available,  and 


a  is  the  relative  imp>ortance  ot  quahty 
v'ersus  quant *ty  in  combat.  Just  as  aval’ 
able  evidence  rev'eals  tiie  asse^^seci  ini- 
portaj’ce  of  performance  versus  quant  ity , 
hlstortcal  data  provides  estimates  of  their 
cutual  Irnpoi  lance.  A  numlx^r  of  empiri¬ 
cal  studies  based  on  F:  cderick  W. 
Lanclicster  s  '•lodel  of  combat  consider 
combat  results  as  a  function  of  quality 
and  quantity  of  forces  engaged. 
Winchester  was  lirst  to  orgai.ize  the 
performance-quantity  issue  within  a 
defined  analytical  framework,  aiul  to 
propose  a  measure  oi  lorce  eliectivcness. 
Tlie  original  fonnulatioji  assumcti  luss 
rate  al  any  insiant  is  based  on  op(K)sii.g 
force  size  and  peribniumce  of  each  unit: 
that  is, 

dx/tit  =  -  ly 

dy/dt  =  -  rg  .V.  (4.2) 

where  x  and  y  are  force  levels  and  the  r/'s 
are  posit iv'e  constants  reflecting  perlbr- 
mance  of  indiv  idual  nmir,. 

System  (4.2)  can  be  solved  for 

-  V^)  /  t.y,,'^  -  i/)  =  /  </.  .  (4. a) 

wbert  jv;,  and  are  the  force  sizes  at  th" 
start  of  the  engagement.  As  is  'vident  in 
(4.3).  the  .squares  of  the  force  sizes  reduce 
at  the  relativ'e  rate  of  {q,^/qj.  Iherefore. 
numbers  are  more  important  tlian  pcrlor- 
niiuice  in  this  particular  model.  For  ex 
ample,  if  the  X  side  were  twice  as 
numerous  as  the  Y.  then  V'  woidd  nev'd 
lour  times  the  performance  of  X  to  have 
tlie  same  combat  capability.  Inncheslt  ' 
propo.sed  his  famous  qu.antity-squared 
measure  of  effectiveness:  "Tlie  fighting 
strength  of  a  force  may  be  broadly  defined 
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as  proportional  to  the  square  of  Its 
numerical  stren^tth  multiplied  by  the 
llj^htlng  value  of  Its  Individual  units. 
Mathematically,  we  ran  state  the  square 
law  as  equaling  fighting  strength  to  [q^ 

In  terms  of  equation  (4.1),  we  can  write 

K=q(.5).v'‘  (4  4) 

James  O.  Taylor,  D.  S.  Hartley,  and 
others  have  generalized  Lanchester's 
equations  (4.2)  to  tlie  form 

tiK /dt  =  y. 

dy/dt  =  ~  q^y’‘ X.  (4.5) 

where  s  Is  a  positive  constant.'^  System 
(4.5)  can  be  solved  for 

(A,,!^  ’•)  /  (y,,'"  ’l-y«^  ’f)  =  (4,6) 

Then,  Lanchester’s  origlnjd  etfectlveness 
measure  (4.4)  can  be  generalized  to 
R  =  y  ■‘'I  .«• 

Present  studies  Identify  three  discrete 
cases  defined  by  the  value  of  s; 

—  If  s  =  0.  we  have  Lanchester's  original  model, 
the  square  effectiveness  measure  appUes.  and 
numbers  are  Important: 

—  if  .s  =  1.  a  similar  measure  of  effectiveness 
applies,  and  effectiveness  is  proportional  to 
quanUty;  numbers  and  performance  are 
equally  Important; 

—  If  s  =  2.  tlicn  numbers  don’t  count  and  only 
quality  matters.^ 

Intermediate,  noninteger  values  are 
“mixed"  cases.  The  effects  of  numbers  on 
combat  effectiveness  are  shown  In  figure 
7.  If  the  parameter  s  Is  greater  than  one. 
tlien  there  are  diminishing  returns  to 
nu  mbers:  If  s  Is  less  than  one.  we  observe 
Increasing  returns.® 

We  can  now  consider  a  question  raised 
in  chapter  3:  What  Is  the  relative  Impor¬ 
tance  of  performance  versus  quantity  in 
combat  effectiveness?  Empirical  studies 
using  generalized  Lanchester  models  (like 
system  (4.51)  indicate  a  mixed  case,  some¬ 
where  between  the  Unear  and  logarithmic 
cases.  D.  S.  Hartley  and  K.  L.  Kruse 


H=lx„^-x‘)/{y„^-f/),  (4.7) 

where  x  and  y  are  forces  remaining  aller 
the  engagement.®  Hartley  and  Kruse 
tlien  proceed  with  an  empirical  model  to 
explain  combat  results: 

I  rill)  =  i)  )  rix^/y^  +  iv.  (4.8) 

where  1  n(H)  is  the  natural  logarithm  of  H, 
(x^/yj  is  the  starting  force  ratio,  and  v 
and  w  are  parameters  to  be  estimated. 

Empirical  results  show  the  relative  Im- 
fKirtance  of  performance  and  quantity  in 
explaining  combat  results;  that  Is,  the 
value  of  u  in  model  (4.8)  corresponds  to 
the  value  of  s  In  system  (4.5).  In  par¬ 
ticular  an  estimated  value  of  v  greater 
than  one  supports  the  importance  of 
numbers.  HauU^  and  Kruse  show  that 
the  estimated  value  of  v  corresponds  to 
the  value  of  a  in  equation  (4.1)  (or  |2sl  In 
equation  (4.7)).'”  The  results  are  shown 
In  table  1 . 


20 


CADRE  i’Al'EK 


Using  model  (4.8),  Hartley  estimated 
the  value  of  v  using  air  and  land  battle 
data.‘‘  The  results  presented  in  table  1 
are  easily  interpreted.  They  are  consis¬ 
tent  with  a  mixed  linear-logarithmic 
model  of  combat  losses.'^  In  terms  of  the 
ellectiveness  measure  (4.1).  tliat  means 
quality  is  not  everything,  but  it  is  more 
Important  than  numbers. 


One  objection  to  this  approai  h  is  dial 
attrition  is  a  simplistic  measure  ol  com 
bat  results.  We  reach  the  same  basic 
conclusion  with  a  more  sophisllcaied  as¬ 
sessment.  Tlie  Quantified  Judgment 
Model  (QJM)  uses  a  richer  metric  lor  land 
combat  residts,  consisting  of  (1)  mission 
accomplishment.  (2)  ability  to  hold 
ground,  and  (3)  casualties  incurred.'* 


Table  1 


Hartley's  Estimates  of  the  Importance  of  Performance  in  Battle 


Data  Set 

Observations 

v' 

Error 

Helmbold 

92 

1  23 

0  12 

55 

81 

1  49 

0  12 

65 

Battle  of  Britain 

17 

1  54 

0  28 

67 

Civil  War 

19 

1  60 

0  27 

67 

Inchon 

19 

1  37 

1  38 

05 

HERO 

263 

1.54 

0  14 

32 

340 

1  20 

0,08 

.38 

24 

1.44 

0.55 

23 

Total 

855 

1.38 

0,06 

.41 

Source:  D  S  Hartley  III.  Historical  Validation  of  an  Attrition  Model  (Oak  Ridge,  Tenn.;  Data  Systems  Engineering 
Organization,  May  1990).  1-4. 

*  If  v>l .  Uien  unit  performance  Is  estimated  to  be  more  Important  tlian  numbers. 


Using  die  QJM  method  of  measuring 
combat  results,  T.  N.  Dupuy  finds  strong 
evidence  of  diminishing  returns  as  more 
numbers  are  added  to  either  side  of  an 
engagement: 

There  Is  evidence  from  historical  combat  that, 
after  a  given  ratio  of  combat  power  is  reached, 
the  addition  of  more  forces  provides  less  in  terms 
of  results  than  would  otherwise  be  expected.  .  .  . 
This  is.  of  course,  a  statement  of  the  familiar  law 
of  diminishing  returns. 

Diminishing  returns  In  combat  are  con¬ 
sistent  with  performance  being  more  Im¬ 
portant  than  numbers,  as  illustrated  in 
figure  7.  Empirical  studies  support  per¬ 
formance  counting  for  more  than  quan¬ 


tity.  and  current  emphasis  on  perfor¬ 
mance  is  consistent  with  that  assessment 
of  what  counts  in  combat. 


Weapons  Design 
in  a  More  Uncertain  World 

The  post-cold  war  era  has  Imposed 
major  changes  on  US  strategy,  defense 
planning,  as  well  as  on  hie  size  and  com¬ 
position  of  forces.  To  a  large  extent,  we 
have  planned  against  a  main  enemy,  the 
USSR,  and  a  main  contingency,  a  large 
Soviet  invasion  of  NATO  Europe  via  the 
Central  FYont."*  There  are  two  major 
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developments  in  the  planning  environ¬ 
ment  . 

1.  The  Soviet  threat,  at  least  as  traditionally 
defined,  has  clearly  diminished.  However,  major 
uncertainties  remain  rej>ardtn(>  Internal  develop¬ 
ments  and  the  prospects  for  arms  <  ontrol  agree¬ 
ments, 

2.  Various  regional  threats  to  national  Interests 
are  more  important,  in  absolute  as  well  as  rela¬ 
tive  terms, 

Tlie  most  Important  implication  lor 
planners  Is  greater  uncertainty  regarding 
actual  mlUtaiy  operations.  Five  years 
ago,  for  example,  few  observers  would 
have  rated  an  Iraqi  seizure  of  Kuwait  as 
the  most  likely  contingency  to  require  a 
military'  response.  Consequently,  the  ef¬ 
fectiveness  of  any  militaTy  force  is  more 
uncertain  as  a  variety  of  operational  fac¬ 
tors  vary  with  contingency.  Including 
hostile  forces,  allied  forces,  basing  ac¬ 
cess,  weather  conditions,  and  so  forth. 
Without  a  compelling  major  scenario 
upon  which  to  anchor  planning,  there  is 
a  greater  need  to  rellect  that  uncertainty 
in  planning  and  resource  allocation 
decisions.'^ 

Fortunately,  an  established  body  of 
knowledge,  called  portfolio  theory, 
provides  useful  insights  In  planning  for 
risky  situations.  In  financial  markets. 
Investors  may  purchase  a  wide  variety  of 
assets,  each  having  an  expected  return 
and  a  certain  amount  of  risk  attached. 
Portfolio  theory  deals  with  the  selection  of 
an  optimal  mix  of  assets  (optimal 
“portfolio").  The  theory  also  has  some 
useful  insights  into  cost-performance 
trade-offs  in  weapon  system  designs.'" 

A  central  assumption  of  the  theory  Is 
that  investors  are  risk  averse,  prefeiring 
less  risky  portlolios.  other  things  being 
equal.  Similarly,  it  is  reasonable  to  sup¬ 
pose  that  defense  planners  are  risk  averse 
with  respect  to  the  capabilities  of  their 
forces  in  various  combat  situations. 

Portfolio  theory  centers  on  utility  max¬ 
imization  under  conditions  of  uncertain¬ 
ty.  Each  asset  has  a  return  that  depends 


upon  general  economic  and  specillc 
market  conditions.  Employing  prob¬ 
ability  distributions  ‘o  estimate  the 
likeliliood  of  the  various  possible  returns, 
the  methodology  computes  Ixith  an  ex- 
pet'ted  value  and  a  spread  in  relunis, 
measured  by  variance  or  standard  devia- 
Iton  In  the  return.  Variability  of  reii.rn  is 
the  measure  for  risk. 

If  alternative  portfolios  are  analyzer!  for 
risk  (liad)  and  expected  return  (good), 
some  candidate  portfolios  are  eliminated 
and  an  elllclent  frontier  emerges.  (See 
curve  AB  in  Qgure  8.)  At  any  point  on  the 
frontier,  one  cannot  find  a  portfolio  with 
a  higlier  rale  of  return  without  also  In¬ 
creasing  risk.  The  frontier  slojjes  upward 
to  the  right,  meaning  tliat  less  risky  as¬ 
sets  have  lower  rates  of  return,  and  com¬ 
mand  a  premium  price  in  the  market."* 


EXPECTED 

RETURN 

\ 

\ 

RISK 

Figure  8 


With  file  absence  of  a  market  and  risk¬ 
free  asset  in  weapons  design,  many  of  the 
results  of  portfolio  theory  do  not  apply 
directly  to  weapon  design.  However,  tlie 
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basic  Insights  gleanetl  are  very  useful. 
We  know  tliat  investors  are  willing  to  pay 
more  lor  a  less  risky  asset  tlian  a  simple 
calculation  of  expected  return  Implies.^ 

'rtie  optimum  system  design  includes 
consideration  of  expected  force  effective¬ 
ness  (good)  and  also  variability  In  effec¬ 
tiveness  (bad).  To  see  the  effects  of  risk 
aversion  In  design  choices,  we  can  revisit 
figure  6  and  Incorporate  the  effects  of 
being  risk  averse  by  formulating  an  ob¬ 
jective  function  to  be  maximized  by 
design  choice; 

i;=  E(fi)  -  A  var(R).  (4.9) 

where  U  Is  the  value  of  “utility”  attached 
to  a  system  design,  E(/?)  Is  expected  eflec- 
tlveness,  var(ff)  Is  variability  of  effective¬ 
ness  as  employment  conditions  change, 
and  A  Is  a  mea  ^;  ire  of  risk  aversion.  If  we 
don't  care  about  risk,  A  is  zero;  Increasing 
risk  aversion  Is  reflected  In  larger  values 
of  A. 

Figure  9  shows  the  effects  of  risk  aver¬ 
sion.  If  Increased  performance  lessens 
risk,  then  the  Indlfferenc-e  curves  rotate 
toward  the  vertlcai — as  shown  by  MM’ 
versus  NN'.  The  result  Is  that  risk  aver- 
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Sion  Increases  system  performance  in  the 
optimum  design. 

Tlie  Implication  Is  that  if  we  lessen  risk 
by  Increased  |x*rformance,  we  should 
chiXise  perlbmiance  levels  beyond  that 
implied  by  exj>ected  value  considerations. 
If  increased  peiibrmance  increases  risk, 
then  the  opposite  conclusion  applies. 

There  is  no  definite  answer  to  the  ques¬ 
tion  of  whether  performance  rediu'es  risk, 
bill  some  results  using  the  TAC  Warrior 
model  of  air  combat  in  Europe  are  inter¬ 
esting  and  suggestive.  A  major  simula¬ 
tion  study,  documented  by  Frederick  L. 
Frostic,  explicitly  considers  quantity- 
performance  issues  in  tactical  air  forces — 
through  analysis  of  equal-cosi 
combinations  of  hlgli-peribrmance  F-15s 
versus  cheaper,  “austere"  fighters.^' 

The  base  rase  for  tl;e  simulation  in¬ 
cluded  clear  air  mass  conditions.  One 
excursion  considered  degraded  weather. 
Results  showed  that  as  weather  condi¬ 
tions  deteriorated,  the  effectiveness  of  the 
lower-performance  option  was  lessened 
much  more:  “The  austere  day  fighter  (ef¬ 
fectiveness)  ...  is  significantly  degraded," 
while  the  F- 15  option  improves  slightly.*^ 
In  terms  of  portfolio  theory,  Frostic's 
results  indicate  higher  system  peiibr¬ 
mance  means  less  variability  in  combat 
jjerfonnance. 

FrosUc's  conclusions  are  only  sugges¬ 
tive.  Franklin  C.  Spinney,  for  example, 
has  argued  that  the  maintainability  of  the 
more  complex  F-15  in  combat  Is  also  a 
source  of  risk.*^  We  need  more  study  of 
such  risks  before  reaching  any  definite 
conclusions.  Some  evidence  shows  that 
higher-performance  designs  lessen  risk, 
and  that  rational  designers  should  there¬ 
fore  show  a  special  willingness  to  pay  for 
more  quality  In  system  designs. 

Implications  for  Planning 


Figure  9 


PERFORMANCE 


Tills  chapter  has  considered  some  fac¬ 
tors  pertaining  to  design  practices  in  Ihe 
post-cold  war  era.  There  are  tw'o  major 
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considerations.  First,  past  emphasis  on 
performance  seems  consistent  with  his¬ 
torical  evidence.  Second,  more  uncer¬ 
tainty  In  force  planning  may  favor 
<  ontlnued  emphasis  on  system  peiidr- 


mance  as  a  means  of  reducing  risk. 
Thougli  It  Is  wortliwhlie  to  rethink  how  we 
design  weapon  systems,  there  Is  some 
good  evidence  that  no  radical  changes  are 
necessary. 
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